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Method and Computer Program for Identification of 
Inattentiveness by the Driver of a Vehicle 

BACKGROUND AND SUMMARY OF THE INVENTION 
[0001] The invention relates to a method and a computer program for 

identifying when a driver of a vehicle, in particular a motor vehicle, is not paying 
attention during operation of the vehicle. The invention also relates to a data 
storage medium having stored thereon such a computer program. 

[0002] Various proposals for detecting inattentiveness by a motor vehicle 

driver, in particular a tendency for the motor vehicle driver to go to sleep, are 
known from the prior art. 

[0003] By way of example, one correspondLng proposal is disclosed in 

German Laid-Open Apphcation DE 198 18 239 Al. The apparatus disclosed 
there for warning that a motor vehicle driver is going to sleep comprises firstly a 
vehicle environment identification device for detection of the actual driving style 
of the motor vehicle driver. The apparatus described there also comprises a 
device for detection of a reference driving style, in particidar detecting how many 
lateral self-movements there normally are by the motor vehicle driver in his 
driving style. Finally, the disclosed apparatus has comparison logic for 
comparison of the reference driving style with the current actual driving style in 
order to output a warning to the motor vehicle driver on the basis of the result of 
this comparison. 

[0004] Furthermore, a method and an apparatus for determination of the 

stress of the driver of a motor vehicle are known firom US Patent 6,061,610. This 
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method provides for the steering wheel angle of the motor vehicle to be detected 
fixst of all in order from this to generate prediction errors for the steering wheel 
angle in the driver's control of the motor vehicle. A distribution of these 
prediction errors is then calculated in order to compare this distribution with 
another distribution of prediction errors of the steering wheel angle which does 
not represent the real steering behavior of the driver, but represents a 
predetermined steering behavior of a stress-free or unstressed driver. The result 
of this comparison then represents the current stress on the driver while driving 
the motor vehicle. 

[0005] Finally, German Laid-Open Application DE 25 46 345 discloses a 

driver warning device for warning motor vehicle drivers before they go to sleep. 
The device detects the steering movement of the driver of the motor vehicle, on 
the assumption that, when the driver is awake, the steering wheel is not held 
entirely at qxiiescent even when traveling in a stradght Une but that steering 
movements are also carried out continuously then, even if they are still very 
small. If the driver warning device detects absence of these steering movements 
over an adjustable time interval, as well, then the driver warning device deduces 
from this that the driver is going to sleep, or is at least at risk of going to sleep, 
and then warns the driver by outputting a signal. 

[0006] The driver warning device disclosed in the last-mentioned 

Laid-Open Apphcation DE 25 46 345 has a disadvantage in that the decision on 
when the driver of a vehicle is not paying attention is made solely on the basis of 
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the detection of a steering quiescent phase, and that this decision can, therefore, 
be made only quite vaguely and unreliably. 

[0007] Against the background of this prior art, the object of the invention 

is, therefore, to provide a method and a corresponding computer program in 
order to identify when the driver of a motor vehicle is not pa5dng attention, as 
weU as a controller for carrying out this method and a data storage medium 
storing such a computer program, which makes it possible to more reliably 
identify possible inattentiveness of the driver. 

[0008] This object is achieved by a method for identifying when the driver 

of a vehicle, in particular of a motor vehicle, is not pa5mig attention. The method 
includes detecting any movement of a steering wheel of the vehicle in the form of 
a steering wheel angle x; and identifying a steering quiescent phase and 
determining the magnitude of the extent of the steering quiescent phase by 
evaluating the detected steering wheel angle and/or its rate of change; wherein a 
steering action is identified following the steering quiescent phase and the 
magnitude of the extent of the steering action is determined by evaluating the 
rate of change of the steering wheel angle; and further wherein a measure of the 
severity of the inattentiveness by the driver is determined while steering the 
vehicle by assessing the result of a hnk between the extent of the steering 
quiescent phase and the extent of the steering action. 

[0009] In the process of identification of inattentiveness of the driver, the 

invention - in contrast to the prior art - advantageously distinguishes between a 

steering quiescent phase and a more or less hectic steering action, which 
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typically follows a state of inattentiveiiess. Thus, according to the invention, a 
state of inattentiveness is not assumed at all unless both the steering quiescent 
phase and the subsequent steering action are identified in conjunction with one 
another; conversely, this means that just identification of a steering quiescent 
phase or of a steering action is not sufficient to deduce inattentiveness of the 
driver. The detected extents of both the quiescent phase and of the steering 
action are logically linked to one another for determination of the extent of the 
severity of the inattentiveness, cuid the result is then assessed. 

[0010] In modern vehicles, in particvilar motor vehicles, a sensor for 

detection of the steering wheel angle x is normally provided in any case. Thus, in 
principle, no additional sensors are advantageously required to implement the 
described method. 

[0011] Two different exemplary embodiments for implementation of the 

invention will be explained in the description and claimed herein. In principle, a 
specific way to determine the extent of the steering quiescent phase is provided 
for a first of the exemplary embodiments; however, this determination process 
can also be carried out according to a second of the exemplary embodiments. 

[0012] Further refinements of the method, as are described and claimed 

herein, apply equally both to the first exemplary embodiment and to the second 
exemplary embodiment. 
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Advantages of the First Exemplary Embodiment 

[0013] Calculation of the extent of the steering action solely by formation 

of a steering wheel angle variance woxild merely represent the steering behavior 
of the driver at one time. However, in order to make a rehable statement on the 
existence of inattentiveness, it is in fact important to take account of changes in 
the steering behavior over time, as well. According to the invention, this aspect is 
taken into account by including two steering wheel angle variances in the 
formation of the variance ratio, which each represent the steering action of the 
driver at different times, with the two times being offset through a time interval 
At with respect to one another. 

[0014] The variance ratio calcidated according to the invention can 

intrinsically advantageously be interpreted as a measure of the severity of the 
inattentiveness of the driver while steering the vehicle at the time ti; 
inattentiveness of the driver exists in particular when this variance ratio has a 
value greater than 1. 

Advantage of the Second Exemnlarv Embodiment 

[0015] In contrast to the first exemplary embodiment, the second 

exemplary embodiment makes use of considerably fewer parameters for 
assessment of the inattentiveness of the driver. It is, therefore, less memory 
intensive. Furthermore, owing to the use of considerably simpler algorithms, it 
can be coped with more easily and can be implemented in real-time. Overall, it is 
therefore highly suitable for practical use in a vehicle. 
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[0016] It is thus advantageous that an assessment of the extent of the 

steering quiescent phase, that is to say its time duration, is preferably made only 
by evaluation of the steering wheel angle, and the extent of the steering action is 
preferably determined only by detection of the maximum steering angle wheel 
gradient that occurs. There is, therefore, no need for any calculation or 
evaluation based on the variance function. 

[0017] Logically hnking the extent of the steering quiescent phase to the 

extent of the steering action in order to determine a measure for the severity of 
the inattentiveness by the driver is carried out in the second exemplary 
embodiment by way of a multi-dimensional operator. In order to save 
unnecessary computation complexity, this logical operation is, however, 
preferably carried out only when both the steering quiescent phase and the 
expected subsequent steering action each take place with a predetermined 
minimum extent. If the steering quiescent phase or the steering action are not 
sufficiently sharply pronounced, then, according to the invention, it is assumed 
that the driver is not in a state of inattentiveness. 

Advantageous Refinements of the Inventive Method Which Both Exemplarv 
Embodiments Mav Emplov 

[0018] The result of the logical operation from the fijrst or second 

exemplary embodiment, that is to say the variance ratio or the result of the 
operator logical operation, can advantageously be mapped onto a probability 
value with the aid of the sigmoid function. This means that it is possible to 
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specify a probability of the driver having been inattentive in the steering of the 
vehicle at the time ti between 0 and 100%. 

[0019] In a further advantageous refinement, the claimed method based on 

the previously determined probability value allows a statement to be made on 
the probability with which the behavior of the driver can be associated with one 
specific fatigue level, which is suitably selected and is predetermined from a 
large number of such levels. According to the invention, an association such as 
this is always made taking into accoxmt the currently detected steering wheel 
angle. 

[0020] This association with the predetermined fatigue levels can 

advantageously be made more precise by taking into account not only the 
steering wheel angle as a first indicator, but also further observable indicators 
for the inattentiveness by the driver, such as his eyelid closure behavior or his 
reaction time. 

[0021] It is also advantageous that the estimate of the fatigue of the driver 

can also be made more precise by taking account for this estimate not only the 
currently detected values of, in particular, the stated indicators, but also the 
fatigue classifications carried out in the recent past. In other words, this 
procedure allows a plausibility check of the new estimate taking into account the 
fact that the driver fatigue is not a phenomenon which occurs or disappears 
again suddenly, but which in fact changes only continuously over the course of 
time. 
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[0022] The inventive method advantageously allows not only, as described 

above, a conclusion to be drawn about driver fatigue as the cause of the detected 
inattentiveness. In fact, it also allows a conclusion to be drawn relating to other 
causes for the detected inattentiveness, which, for example, may He in a 
conversation being held with a front seat passenger or the operation of an 
apparatus, such as the radio or the glove compartment in the vehicle. 

[0023] In order to improve the reliabihty of a statement relating to the 

attention level or inattentiveness of the vehicle driver, it is worthwhile 
evaluating not only a result of the logical operation according to the first or 
second exemplary embodiment but, instead of this, for this statement to be based 
on a large number of such logical operation results. In this case, this plurality 
may include not only merely results firom the first or from the second exemplary 
embodiment, but also a mixture of results firom the first and from the second 
exemplary embodiment. Specifically, a statement can be made more reliably 
about the inattentiveness by the driver by weighting each result obtained from a 
logical operation with an associated weighting factor in order then to obtain an 
averaged logical operation result in the final analysis from the present plurahty 
of weighted logical operation results, by mathematical averaging. This averaged 
logical operation result then represents a more reUable measure than a 
non-averaged logical operation result of the severity of the inattentiveness by the 
driver in the steering of the vehicle at a specific time. 



-8- 



t 



Attorney Docket: 095309. 57739US 
Clean Version of Substitute Specification 

[0024] Finally, it is advantageous, in particvilar, for the driver of the 

vehicle to be informed of the identified inattentiveness in the form of visual or 
audible warning information. 

[0025] Further advantageous refinements of the method are described and 

claimed herein. 

[0026] The object of the invention as mentioned above is also achieved by a 

computer program for carrjdng out the described method, by a data storage 
medium with the computer program, and by a controller for carrying out the 
described method. The advantages of these solutions correspond to the 
advantages mentioned above with respect to the described method. 

[0027] This computer program advantageously need be programmed only 

once at least for individual vehicle types, and can then be implemented in all the 
vehicles of a corresponding model. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0028] Figure 1 shows a controller according to the invention; 

[0029] Figure 2 shows an example of the profile of the steering angle x 

when driver inattentiveness occurs, according to the invention; 

[0030] Figure 3 a is a flow chart of the method according to the invention 

based on a first exemplary embodiment; 

[0031] Figures 3b and 3c, in conjunction with Figure 3a, are flow charts of 

the method according to the invention based on a second exemplary embodiment; 

[0032] Figure 4 illustrates a sigmoid function; 
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[0033] Figure 5 illustrates a first cause and effect diagram; 

[0034] Figure 6 shows Gaussian distributions for various extent levels in 

which a probability value, which represents the inattentiveness by the driver, 
may occur; and 

[0035] Figure 7 illustrates a second cause and effect diagram. 

DETAILED DESCRIPTION OF THE DRAWINGS 

[0036] Figure 1 shows a controller 100 for carrying out the method 
according to the invention for identification of inattentiveness by the driver of a 
vehicle, in particxilar of a motor vehicle. The controller is preferably mounted in 
the vehicle (not shown) and includes a steering wheel angle sensor 110 for 
detecting the current steering wheel angle x, that is to say, the steering 
movement, caused by the driver. The controller 100 furthermore includes a 
control unit 120, which is preferably in the form of a microcontroller. The control 
unit 120 detects a sensor signal, which is produced by the steering wheel angle 
sensor 110 and represents the steering wheel angle x. 

[0037] The steering wheel angle x represents a first indicator, which is 
preferred according to the invention, for inattentiveness by the driver. In 
addition to the steering wheel angle, the control unit 120 can also, in principle, 
receive and evaluate further sensor signals from other sensors 112, 114 as 
further indicators of the inattentiveness by the driver. Such further sensor 
signals will not be described at this point, but are mentioned further below in the 
description. 

-10- 



Attorney Dcx:ket: 095309. 57739US 
Clean Version of Substitute Specification 

[0038] Inattentiveness by the driver is identified by running a computer 

program 122 in the control unit 120, which program identifies the 
inattentiveness using a method according to the invention and described in the 
following that evaluates the steering wheel angle x used as a preferred indicator. 
If inattentiveness by the driver is found, then it is advantageous for the control 
unit 120 to drive a warning device 130 in order that it emits audible or visual 
warning information to the driver. The warning information makes the driver 
aware of his inattentive behavior in driving of the vehicle, and provides him with 
the opportunity to re-estabhsh his attention. 

[0039] Figure 2 shows a typical profile of the steering wheel angle, as 
occurs when inattentiveness by the driver has been identified with the aid of the 
present invention. To this extent, this profile is typical of the existence of 
inattentiveness by the driver in which, first of all, he has a steering quiescent 
phase LR in which he makes no significant changes. In Figure 2, the steering 
angle x remains in the deflection range Ax, which is bounded by the two parallel 
horizontal hnes, throughout the steering quiescent phase LR. The presence of 
inattentiveness in the sense of the invention is then characterized by a very 
sharp or powerful steering action, which foUows this steering quiescent phase. 
This powerful steering action LA is represented in Figure 2 by the rapid rise in 
the steering angle x at the end of the quiescent phase. 

[0040] Figure 3 shows the method according to the invention, implemented 

with the aid of the controller 100 described above. The method steps SO - S8 
shown in Figure 3a first of aU represent a first exemplary embodiment of this 
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method. This will be described first of all in the following text in detail and in a 
related form. The branches A, B, C and D shown in Figure 3a are irrelevant to 
this first exemplary embodiment; these will not become relevant until the 
description of a second exemplary embodiment of the method according to the 
invention, which follows the description of the first exemplary embodiment. 

First Exemplary Embodiment 

[0041] Following a starting step SO, the first exemplary embodiment as 

shown in Figure 3a first of all provides for the detection of a steering movement 
of the steering wheel of the vehicle, that is to say the detection of the steering 
behavior of the driver in the form of the steering wheel angle x (method step Si). 
The steering qmescent phase LR, see Figure 2, is then identified in a second step 
S2 on the basis of the detected steering wheel angle x. A variance ratio w (x, ti) 
is then likewise calculated in step 2, as the quotient of a second divided by a first 
steering wheel £mgle variance. In this case, the first steering wheel angle 
variance v(x, ti - At) at an early time ti - At is calculated using the following 
formula (1): 

(t,-At-T) _ 

i;(x,t/-At)=var(x(ti-At), x(ti-At-T))=- Y,(x(t)'X)^ (1) 

^ Mt,-At) 

where: 

x(ti-At) represents the steering wheel angle x at the time ti-At; 
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At represents a mxiltiple of the sampling interval; 

T represents an observation time window; 

ti-At represents the observation time; 

X represents a mean time value of the steering wheel angle x 

averaged over the observation time window T; and 

var represents the mathematical variaince function. 

[0042] The second steering wheel angle variance v(x, ti) is calculated using 



the following formula (2): 

i;rx,fi)=var(x(ti), x(ti-T))=i^^(x(t)-x)' (2) 

t={tj) 

where the variables have the same meanings as in the formula (1) with the only 
difference being that they are considered at the observation time ti. 

[0043] The variance ratio w(x,ti) is then calculated from the first and 

second steering wheel angle variances as follows: 

w(x,ti)=— ^^^^i^ (3) 
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[0044] The variance ratio calculated in method step S2 therefore 
represents a reliable measure of the severity of the inattentiveness of the driver 
in steering of the vehicle at the time ti, because it effectively records the typical 
steering behavior of a driver when he is not pa5dng attention. A t3rpical steering 
behavior when the driver is not paying attention is characterized — as has 
already been stated above with reference to Figure 2 — by a first steering 
quiescent phase LR without any steering activity, or with only a minor amoxmt 
of steering activity, and by a subsequent second steering action phase LA with 
above-average powerful steering movements. The first phase leads, at the early 
observation time ti - At, to the first variance at a small magnitude. In contrast, 
the second phase, in particular at the time ti, leads to a considerably greater 
value for the second variance. Overall, this results in a small value for the 
denominator and a large value for the numerator, so that, overall, these two 
effects result in a high value for the variance ratio. As long as the variance ratio 
is < 1, this indicates that the driver is not inattentive. Only when the variance 
ratio assumes a value greater than 1 does this indicate that the driver of the 
vehicle is not paying sufficient attention to the road traffic. 

[0045] The value of the variance ratio may, in theory, be indefinitely high. 

However, indefinitely high values of this type are unsuitable to allow the 
inattentiveness of the driver to be classified sufficiently accurately. 

[0046] In one particular variant of the method according to the invention, 

the variance ratio is therefore converted to a probability value in a subsequent 
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method step S3. This conversion is preferably carried out with the aid of a 
sigmoid function, which is illustrated in Figure 4 and has a suitable 
predeterxnined threshold value SW. This threshold value for the sigmoid function 
illustrated in Figure 4 is SW = 2. This means that a variance ratio w(x, ti) 
(which is plotted on the abscissa in Figure 4) of 2 indicates a probability P(Un), 
where n = 1 (first indicator), of 0.5, that is to say of 50%, of the driver of the 
vehicle having been inattentive at the time ti. As can be seen from the graph of 
the sigmoid function in Figure 4, the probability P(Ui) may, in principle, assume 
a value between 0 and 100%, depending on the magnitude of the variance ratio. 

[0047] The sigmoid function ensures a "soft" transition from total attention 

corresponding to a probability value for the instantaneous inattentiveness of 0 to 
total inattention, corresponding to a value for the inattentiveness of 1 = 100%. 
Mathematically, the sigmoid function illustrated in Figure 4 is calcvdated using 
the following formula (4): 



P(Ui) = 



\ + e 



-(vv('.'l)-'S) 



(4), 



where 



P(Ui) 



represents the probability of the inattentiveness by the driver in 



steering the vehicle, with 
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Ui representing an inattentiveness event detected with the aid of the 

first indicator (steering wheel angle: n = 1), and 

S representing the threshold value. 

[0048] The evaluations of the steering wheel angle x carried out so far 

(that is to say up to and including the method step S3) have allowed 
identification of the presence or absence of inattentiveness by the driver at the 
time ti. A further evaluation of the knowledge obtained up to this point, 
preferably with the aid of a dynamic probabilistic model, further allows 
conclusions to be drawn relating to the possible causes of inattentiveness that 
have been found. The method steps S4 - S6, which will be described in the 
following text, therefore indicate a method with whose aid, for example, it is 
possible to determine the probabihty that fatigue is the cause of the driver 
inattentiveness that has been detected. 

[0049] This relationship, which has just been described, between fatigue 

being the cause of inattentiveness in the steering of the vehicle resulting from 
this is illustrated in Figure 5. The arrows shown there point from fatigue as the 
cause to various possible effects, in particular to inattentiveness in the steering 
of the vehicle (indicator 1). In addition to the effect of inattentiveness, fatigue 
may, however, also have other observable effects, such as frequent closure of the 
eyeUds (indicator 2) or a delayed reaction capabihty (indicator 3). 
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[0050] In order to make it possible to deduce driver fatigue from a detected 

inattentiveness event in the steering of the vehicle, a first probability vector On=i 
is, according to the invention, determined in the method step S4, whose elements 
On=i, kn=i each represent probability values of the probability value P(Ui) 
occurring in individual, predetermined, and suitably selected extent levels kn, 
where kn e {l..,K}. The parameter n in this case represents a respectively 
evaluated indicator, with n = 1 representing the steering behavior or the steering 
wheel angle as an indicator. 

[0051] Figure 6 illustrates the process for determination of the first 

probability vector On=i. In this figure, the probability value P(Ui) as determined 
in the previous method step S3 is plotted between 0 and 100% on the abscissa, 
representing the probability of inattentiveness by the driver in steering the 
vehicle at the time ti. The previously determined probability value P(Ui) will 
now be predetermined in the method step S4, and associated with suitable 
defined extent levels kn e {l..,Ki}. In the exemplary embodiment shown in 
Figure 6, three extent levels were predetermined, "low" (ki = 1), "medium" 
(ki = 2) and "high" (ki = 3) (see Figure 5) for the indicator 1, and each is 
represented by their own Gaussian function in Figure 6. The number of extent 
levels for the indicator 1 in this example is thus ki = 3. 

[0052] The number and parameters of these Gaussian functions for the 

respective extent levels, such as their center points or their variances, can be 
configured appropriately depending on the application. As can be seen from 
Figure 6, a probability of 70% of this probability value occurring with only a 
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small extent woxild be associated, after carrying out the method step S4, with a 
probability value PG^i) (assumed by way of example) of 0.33 for the 
inattentiveness by the driver. There is a 28% probabihty of the calcxilated 
probability value occurring with a medium extent, while there is a probabihty of 
only 2% of the calculated probabihty value occurring with a high extent. 

[0053] In other words, in the case of the example illustrated in Figure 6 for 

the assumed probabihty value of 0.33 for the inattentiveness by the driver at the 
time ti, results in the statement that the probabihty of inattentiveness by the 
driver having only a low extent occurred with a probabihty of 70%, that is to say 
there was a 70% probabihty that the driver was paying attention. This also 
resxdts in the statement that there was a probabihty of 28% that the driver was 
paying medium attention, and that there was a probabihty of only 2% of him 
being highly iuattentive. 

[0054] An indefinite number of fatigue levels can now be defined in the 

next method step S5, and conditional probabihties between these levels as well 
as the observed steering inattentiveness event can now be allocated. In the 
example shown in Figure 5, a total of three fatigue levels "awake", "tired" and 
"fatigued" are provided. Conditional probabihties can then likewise be allocated, 
also in the method step S5, in the form of a matrix B between each of these 
fatigue levels and one of the extent levels described above. This matrix B covers 
a total number of matrix elements, which is calculated firom the product of the 
number of extent levels miiltiphed by the number of predetermined fatigue 
levels. If there are three extent levels "low", "medium" and "high" for the steering 
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inattentiveness event, the three fatigue levels mentioned above result in a total 
nunaber of 3 * 3 = 9 conditional probabilities for the matrix B. By way of example, 
one of these probabilities indicates how high the probability is of a steering 
inattentiveness event in the "high" extent level occurring, given that the 
probabilistic model in the first fatigue level is "awake". These conditional 
probabilities can be configured appropriately. 

[0055] With the probability vector On=i as determined in step S4, and the 
calculated matrix B, it is now possible to determine, in a method step S6, a 
fatigue probabihty vector S* associated with individual, predetermined and 
suitably selected fatigue levels, whose elements each represent probabilities P 
(fatigue level) of the detected inattentiveness by the driver in steering the 
vehicle. The fatigue probability vector S' is calculated using the following 
formula (5): 



SXt)=O^Bi 



(5), 



where 




represents the transpose of the first probability vector; and 



Bi 



represents the matrix B for the detected indicator for steering 



inattentiveness, represented by the index 1. 
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[0056] The calcvilatioii rule (5) just described for calculation of the fatigue 

probability vector S' has the disadvantage that it is based only on an evaluation 
of the steering wheel angle x as an indicator (n=l). Other possible observable 
effects of fatigue, such as those indicated in Figure 5 by the indicators 2 (for 
example eyehd closure frequency) or the indicator 3 (for example reaction time) 
are not included in the formula 5 for calculation of the fatigue probabihty vector. 

[0057] However, it is also possible to use these indicators 2 and 3, as well 
as further suitable indicators n, for example the yaw angle of the vehicle, the 
distance from the vehicle in front or the leaving of a lane, to the extent that these 
can be measured, for calculation of a more precise fatigue probability vector S". 
The method steps S4 and S5 which have just been described must then be 
carried out in each case not only for the observed steering angle as the indicator 
n = 1, but also for further desired indicators such as the eyeUd closure behavior 
(n = 2) and/or reaction time (n = 3), etc., separately (method step S5a). In the 
course of method step S4, an individual nimiber of extent levels Icn (where kn = 
1...K) must then be defined individually for each indicator n. This number of 
extent levels kn then, in each case, corresponds to the number of elements in a 
probabihty vector On associated with the respective indicator. These elements 
On,kn, in each case, represent probabihties P(On ,kn) of probability values P(Un) for 
the other inattentiveness indicators n = 2.,.N occurring in addition to the 
steeling inattentiveness n = 1 in the individual extent levels kn which are 
predetermined and suitably selected individually for the indicators. 
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[0058] A corresponding matrix Bn can then also be predetermined 

individually for these further indicators n, corresponding to the method step S5, 
once again. The more precise fatigue probability vector S*' is then calculated on 
the basis of the data that is then available in step S6, using the following 
formxila (6): 

S\t)=YlolB„ (6), 

represents the n-th indicator for the inattentLveness by the driver, 

represents the k-th element of the vector On or the k-th extent level 
for the indicator n; 

represents the transpose of a probabihty vector; 

represents the matrix of conditional probabihties between individual 
predetermined fatigue levels and an inattentLveness event which is 
indicated by the indicator n; and 

represents the number of indicators used. 



where: 
n 

kn 

Ol 

Bn 

N 



[0059] In the two variants which have been described so far for calculation 

of the fatigue probability vector S, only the severity of a detected inattentiveness 
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event has been traced back to the most probable actual fati^e level, be this on 
the basis of a detected steering inattentiveness event or else on the basis of 
additionally detected events, such as increased eyeUd closure behavior or 
shortened reaction time. Further details of this process of tracing back from the 
observed inattentiveness to an existing fatigue level as the cause of this 
inattentiveness can be achieved by taking account not only the severity of the 
inattentiveness event, but also the most probable fatigue level determined in a 
previous time interval. This ensures that once an inattentiveness event has been 
detected, or has been detected for the first time, this does not in itself lead 
immediately to the conclusion that the fatigue level is high. This wovdd not be 
consistent with the actual characteristic of fatigue since, in principle, fatigue is a 
phenomenon which does not occur suddenly, but builds up slowly only over the 
course of a certain period of time. 

[0060] In the case of the three fatigue levels mentioned above and 

described in Figure 5, the change from one fatigue level to another is therefore 
provided with different conditional probabihties. These conditional probabilities 
are preferably predetermined in a suitable manner in the form of a matrix A in 
the course of the probabilistic model. The conditional probabihties in the matrix 
A are intended, in particular, to express the fact that, for example, a direct 
transition from fatigue level 1 "awake" to fatigue level 3, "fatigued" is 
considerably less probable than a direct transition from level 1 to level 2, "tired", 
in which, in comparison to level 1, initial adverse effects in terms of the attention 
of the driver can now be identified. The configuration of the matrix A should also 
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take account of the fact that the transitions from being awake to a state of 
greater fatigue take place with different conditional probabilities, in the same 
way as the transitions from a fatigued state to being awake. 

[0061] With the most probable fatigue level determined in a pervious time 

period also being taken into account, the fatigue probabihty vector S**', which has 
once again been made more precise in this way, is then calciilated in step S7 
using the following recursive formxda (7): 

S"'(ti) = S"(ti) . A . S'"(ti - 1) (7), 

where 

S*'(ti) represents the more precise fatigue vector S" without consideration 

of the most probable fatigue level determined in the previous time interval; 

A represents the matrix of conditional probabilities between a fatigue 

level in the most recent time interval and a current fatigue level; and 

S"'(ti-1) represents the more precise fatigue vector S'" in the time period ti - 
1. 

[0062] It is recommended that an initial value of S'" (0) = (1, 0, 0)Tbe used 

as the third variant in order to start the recursive calculation of the more precise 
fatigue probabihty vector S'" using the formxila (7). 
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[0063] In other words, the more precise calctilation of the fatigue 

probability vector S"' using the formula (7) results in the fatigue vector being 
smoothed over time, and/or prevents an inattentiveness event which has been 
identified for the first time immediately leading to a sudden change in the 
fatigue level which is assumed to be the most probable cause of the detected 
inattentiveness event. Suitable configuration of, in particular, the matrix A also 
ensures that, conversely, a high degree of attention by the driver, which is 
detected suddenly, does not immediately lead to a low fatigue level if a very high 
fatigue level has been determined to be the probable cause of detected 
inattentiveness immediately before this. 

[0064] The method described so far has always had the aim of deducing a 

certain fatigue level as the cause of the detected inattentiveness on the basis of 
detected steering inattentiveness and, optionally, also on the basis of further 
indicators for inattentiveness by the driver. This is illustrated once again in 
graphical form in Figure 7, where the arrows point from a cause to an effect. 
However, the directions of the arrows in Figure 7 also show that, according to the 
model on which this is based, that fatigue is immediately the sole cause for the 
indicators 2, that is to say the eyelid closing behavior, and 3, that is to say 
shortened reaction time, but that this need not be the only cause of detected 
steering inattentiveness. In fact, in addition to or as an alternative to fatigue, a 
given temporary distraction of the driver may also be the cause of detected driver 
steering inattentiveness. The reason for distraction may in turn be, for example, 
a conversation being held with the front seat passenger or an action carried out 
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on a control element, for example the radio or the glove compartment in the 
vehicle. If, in addition to the previously mentioned inattentiveness events or 
indicators, possible causes for distraction are also additionally detected with the 
aid of suitable sensors, such as a microphone 112 or a camera 114 (see Figure 1), 
then these detected events can be evaluated with the aid of the probabihstic 
model in order to make a statement about the probability with which it can be 
assumed that the driver has been distracted, for example owing to a conversation 
being held or a control action being carried out, and the probabihty of fatigue 
being the cause of the observed inattentiveness. 

[0065] The driver inattentiveness, which is detected by one of the variants 

of the first exemplary embodiment, is finally compared with an error criterion, in 
particular with a respectively suitably predetermined threshold value, in order 
to then output a warning signal to the driver on the basis of the result of this 
comparison (method step S8 as shown in Figure 3a). 

Second Exemplarv Embodiment 

[0066] The second exemplary embodiment of the method according to the 

invention is admittedly, in principle, independent of the fixst exemplary 

embodiment, but has individual method steps which are identical to the 

individusd method steps from the fixst exemplary embodiment. One fundamental 

difference between the first and the second exemplary embodiments is that, in 

the fixst exemplary embodiment, the identification of a steering action LA and 

the calculation of a logical operation resxilt between the extent of the steering 

quiescent phase and the extent of the steering action coincide in the form of the 
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calculation of the variance ratio. In contrast, the second exemplary embodiment 
offers the advantage that not only the steering quiescent phase LR but also the 
subsequent steering action LA and the logical Unking according to the invention 
of the extents of these two phases can, in each case, be carried out separately as 
separate method steps, as will be described in more detail in the following text 
with reference to Figures 3a, 3b and 3c. 

[0067] After a starting step SO, the second exemplary embodiment as 

shown in Figure 3a first of all provides for the detection of the steering 
movement of the steering wheel of the vehicle, that is to say the detection of the 
steering behavior of the driver in the form of the steering wheel angle x (method 
step Si). To this extent, the first and the second exemplary embodiments still 
coincide. For the second exemplary embodiment, this is now not followed by the 
method step S2 as shown in Figure 3a, but rather the method branches via the 
mark A to Figure 3b, while the extent of the steering quiescent phase is first of 
all determined in the method step S2/2. The extent of the steering quiescent 
phase means, in particular, its time duration. A steering quiescent phase exists 
for as long as the steering angle of the vehicle is within a predetermined steering 
wheel angle interval Ax as shown in Figure 2. The time period for which this 
situation lasts then represents the extent of the steering quiescent phase LR. 

(0068] The extent of a steering action following the detected steering 

qviiescent phase is then detected in a method step S3/2. The maximum gradient 
of the steering angle, which then occurs is determined for this purpose. In Figure 
2, this gradient is illustrated in the form of the gradient of the steering angle, 

-26- 



* 

r 

Attorney Docket: 095309. 57739US 
Clean Version of Substitute Specification 

how it occurs, once the steering wheel angle has left the steering wheel angle 
interval Ax. 

[0069] The extent of the steering quiescent phase and of the steering action 

are then linked to one another in the method step S4/2 by means of a 
multidimensional operator. The multidimensional operator may be a family of 
characteristics, a weighting function or a logical decision function. The result of 
this use of the multidimensional operator then represents a suitable measure for 
the severity of the inattentiveness of the driver in steering the vehicle. The 
logical linking of the two extents which have been mentioned is, however, 
preferably carried out only when it has been found in the steps S2/2 or S3/2 
(which were carried out prior to this) that the extent of the steering quiescent 
phase in the form of its time period is greater than a predetermined minimum 
time period, and the maximum gradient of the steering wheel angle is greater 
than a predetermined gradient threshold value. Otherwise, the extents of the 
steering quiescent phase and of the steering action are not regarded by the 
method according to the invention as being sufficiently strongly pronoimced in 
order to allow the deduction of driver inattentiveness as a result of their 
combined presence. 

[0070] The multidimensional operator is preferably dimensioned on the 

basis of the current speed of the vehicle and/or on the basis of the dynamics of 
the driving style of the vehicle driver. Specifically, this means that the 
evaluation of the detected extents of the steering qviiescent phase and of the 
steering action take account of the fact that steering movements are tjrpically 
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less at high vehicle speeds than at low speeds. Matching to the driving style of 
the driver prevents a hectic steering movement which is carried out deliberately, 
for example by a rally driver, in conjunction with a previously detected supposed 
steering quiescent phase, incorrectly being interpreted as driver inattentiveness. 

[0071] The logical operation result determined in method step S4/2 

according to the second exemplary embodiment can now be evaluated and 
processed further in various ways. 

[0072] A first option is to normalize this with the aid, for example, of the 

sigmoid function. This option is shown by the mark B in Figure 3b, which 
branches to the input of the method step S3 in Figure 3a. It is then possible to 
carry out not only the method step S3, but then also all the further method steps 
S4 to S8, as described above with reference to Figure 3a. 

[0073] A second option for further processing of the logical operation result 

obtained in the method step S4/2 admittedly once again includes the 

normalization process with the aid of the sigmoid function in method step S3, but 

the evaluation process does not then continue further in accordance with method 

step S4 and so on. Rather, as is indicated by the mark C in Figure 3a, the 

further processing continues in method step S9, as shown in Figure 3c. This step 

indicates that the calculation of the logical operation result which has already 

been carried out, irrespective of whether this was in accordance with the first 

exemplary embodiment in step 2 or in accordance with the second exemplary 

embodiment in step S4/2, should be carried out more than once during a 

predetermined measurement time interval. The repeated calculating of the 
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logical operation results at different times ti. where i = l-I throughout the 
measurement time interval leads to a large number of logical operation results, 
preferably being available at the end of the measurement time interval. These 
logical operation results are preferably (as already described) tapped off at the 
output of the method step S3, because they are then in a normalized form. 
However, alternatively, the logical operation results which have been obtained 
directly in the method steps S2 and S4/2 can also be collected and stored directly 
in method step S9. These logical operation results are then individually weighted 
in the method step SlO, by allocating a weighting factor to each of these results. 
These weighting factors represent the respective driving situation of the vehicle 
or the current distraction of the driver, in each case at a time to which the logical 
operation result relates. 

[0074] Then, finally, a weighted logical operation result is calculated in the 

method step Sll by mathematical, preferably arithmetic, weighted averaging of 
the logical operation results obtained during the measurement time interval, 
taking into account the weighting factors associated with them. 

[0075] The weighting factors are defined taking into account the time of 
day, that is to say circadian influencing factors and/or the time since the start of 
the journey. The weighted result of the logical operation provides a very reHable 
measure which, in particular, is relatively simple and fast, for the severity of the 
inattentiveness of the driver while driving the vehicle. This averaged result of 
the logical operation is then preferably subjected to an error criterion, as in 
Figure 3c in conjunction with Figure 3a via the mark D in the method step S8, 
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and is evaluated in order to generate a warning signal for the driver. The error 
criterion is satisfied when the sura of all of the logical operation results 
calculated in the most recent x minutes, in each case weighted with their 
individual weighting factors, exceeds a predetermined threshold value. 

[0076] The second option, as described above, for further processing of the 
logical operation result obtained in the method step S4/2 according to the second 
exemplary embodiment, by means of the steps S9 to Sll, is also appropriate, in 
the same way, for the logical operation result obtained in the method step S2 
according to the fLrst exemplary embodiment. 

[0077] A third option for further processing of the logical operation result 

from step S2 or from step S4/2 is to preferably carry out the steps S4 to S7 and 
S9 to Sll in parallel, in time. 

[0078] The two exemplary embodiments of the method according to the 

invention, in all of their variants, are preferably implemented in the form of at 
least one computer program. If required, the computer program may be stored 
together with further computer programs in a data storage medium. The data 
storage medium may be a floppy disk, a compact disk, a so-called flash memory 
or the like. The computer program which is stored in the data storage medium 
can then be sold as a product to a customer. As an alternative to transferring it 
in the form of a data storage medium, it is also possible to transmit it via a 
communications network, in particxilar the Internet. 
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